Papers with question generator
QACheck: A Demonstration System for Question-Guided Multi-Hop Fact-Checking (2023.emnlp-demo)
Copied to clipboard
| Challenge: | Existing fact-checking systems lack transparency in their decision-making process, making it difficult for users to comprehend their reasoning process. |
| Approach: | They propose a Question-guided Multi-hop Fact-Checking system which asks a series of questions critical for verifying a claim. |
| Outcome: | The proposed model provides a comprehensive report detailing its reasoning process, guided by a sequence of questions, answer pairs, and the source of evidence supporting each question. |
Synthetic Question Value Estimation for Domain Adaptation of Question Answering (2022.acl-long)
Copied to clipboard
| Challenge: | Existing work adapts QA scores to select high-quality questions, but these scores do not improve QA performance on the target domain. |
| Approach: | They propose to synthesize QA pairs with a question generator on the target domain . they propose to train a Question Value Estimator that estimates usefulness of synthetic questions . |
| Outcome: | The proposed method improves the performance of the target domain QA model by using synthetic questions and only 15% of the human annotations on the targetdomain. |
Guiding Visual Question Generation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to Visual Question Generation (VQG) are trained to mimic an arbitrary choice of concept but only one or a few are captured by the human references. |
| Approach: | They propose a variant of Visual Question Generation which conditions the question generator on categorical information based on expectations on the type of question and the objects it should explore. |
| Outcome: | The proposed model improves on the current state of the art on an answer-category augmented VQA dataset and human evaluation validates that guidance helps the generation of questions that are grammatically coherent and relevant to the given image and objects. |
A Reinforcement Learning Framework for Natural Question Generation using Bi-discriminators (C18-1)
Copied to clipboard
| Challenge: | Existing research on visual question generation is focused on training models to fit the annotated data set that makes them indifferent from other language generation tasks. |
| Approach: | They propose to use two discriminators to enhance the training of a visual question generator to ask natural questions about an image. |
| Outcome: | The proposed model outperforms state-of-the-art models in terms of automatic and human evaluation metrics. |
Reinforced Dynamic Reasoning for Conversational Question Generation (P19-1)
Copied to clipboard
| Challenge: | Empirical results on the recently released CoQA dataset demonstrate the effectiveness of our method . large-scale highquality conversational question answering datasets such as CoQA and QuAC can help train models to answer sequential questions. |
| Approach: | They propose a task called Conversational Question Generation which generates a question based on a passage and a conversation history to generate the next question. |
| Outcome: | The proposed method is based on a question-answering style conversation dataset . it can be used to generate meaningful questions on QA and SQuAD datasets . |
Reinforced Multi-task Approach for Multi-hop Question Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Empirical evaluation shows our model to outperform the single-hop question generation models on both automatic evaluation metrics such as BLEU, METEOR, and ROUGE and human evaluation metrics for quality and coverage of the generated questions. |
| Approach: | They propose a question-aware reward function to maximize the utilization of supporting facts in the context. |
| Outcome: | The proposed model outperforms single-hop neural question generation models on automatic evaluation metrics and human evaluation metrics for quality and coverage of the generated questions. |
CYCLE-INSTRUCT: Fully Seed-Free Instruction Tuning via Dual Self-Training and Cycle Consistency (2025.emnlp-main)
Copied to clipboard
Zhanming Shen, Hao Chen, Yulei Tang, Shaolin Zhu, Wentao Ye, Xiaomeng Hu, Haobo Wang, Gang Chen, Junbo Zhao
| Challenge: | Existing methods for instruction tuning rely on expensive human-annotated seed data or powerful external teacher models. |
| Approach: | They propose a framework that achieves fully seed-free instruction tuning by employing a dual self-training loop where two models are bootstrapped solely from raw, unlabeled text. |
| Outcome: | The proposed framework outperforms seed-driven back-translation baselines and achieves comparable performance to strongly supervised methods. |
QAConv: Question Answering on Informative Conversations (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that state-of-the-art pretrained QA systems have limited zero-shot performance and tend to predict our questions as unanswerable. |
| Approach: | They propose a question-answering dataset that uses conversations as a knowledge source. |
| Outcome: | The proposed dataset provides a training and evaluation testbed to facilitate QA on conversations research. |
Question Generation Based on Grammar Knowledge and Fine-grained Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Recent research on question generation has achieved great success, but some question types and answers did not match. |
| Approach: | They construct a question type classifier and a query generator to solve the problem of question types not matching with other questions. |
| Outcome: | The proposed model improves the accuracy of interrogative words in generated questions. |
Learning by Analogy: Diverse Questions Generation in Math Word Problem (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for solving math word problem (MWP) use shortcut learning to train solvers based on samples with a single question. |
| Approach: | They propose to generate diverse yet consistent questions from a common scenario . they then feed the equations to a question generator to obtain the diverse questions . their method leads to performance improvement on the current benchmark Math23K . |
| Outcome: | The proposed method generates diverse yet consistent questions with a variety of equations and questions . it improves on the current benchmark, which is based on the proposed method . |
Select High-quality Synthetic QA Pairs to Augment Training Data in MRC under the Reward Guidance of Generative Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches focus on downstream metrics to select QA pairs, which lack generalization across different datasets. |
| Approach: | They propose a general selection method that uses a large pre-trained language model as a reward model in a Reinforcement Learning framework for the training of the selection agent. |
| Outcome: | The proposed method improves performance on generative and extractive datasets. |